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Abstract. We consider Ornstcin-Uhlenbeck processes (OU-processes) associ- 
ated to hypoelliptic diffusion processes on finite-dimensional Lie groups: let C 
be a hypoelliptic, left- invariant "sum of the squares" -operator on a Lie group 
G with associated Markov process X, then we construct OU-processes by 
adding negative horizontal gradient drifts of functions U. In the natural case 
U(x) = — logp(l,x), where p(l,x) is the density of the law of X starting at 
identity e at time t = 1 with respect to the right-invariant Haar measure on G, 
we show the Poincare inequality by applying the Driver-Melcher inequality for 
"sum of the squares" operators on Lie groups. The resulting Markov process 
is called the natural OU-process associated to the hypoelliptic diffusion on G. 

We prove the global strong existence of these OU-type processes on G 
under an integrability assumption on U. The Poincare inequality for a large 
class of potentials U is then shown by a perturbation technique. These results 
are applied to obtain a hypoelliptic equivalent of standard results on cooling 
schedules for simulated annealing on compact homogeneous spaces M. 



1. Introduction 
We consider an invariant hypo-elliptic diffusion process X, 

d 

dX? = Y,Vi(,X?)odBl X$=x 

i=l 

on a connected Lie group G together with a right-invariant Haar measure /i, which 
is then also invariant for the diffusion process X. The vector fields Vi,...,Vd 
are assumed to be left-invariant vector fields, and their brackets generate the Lie 
algebra. In the spirit of sub-riemannian geometry the hypo-clliptic diffusion process 
can be used to define a metric (the Carnot-Carathcodory metric d) a geodesic 
structure and the notion of a gradient (the horizontal gradient grad ftor ) on G. The 
density of the law of Xf with respect to fi is denoted by p(i, .) and smooth by 
Hormandcr's theorem. 

Fix t > 0. The natural Ornstein-Uhlenbcck process on G associated to X will 

be 

1 d 
dY t = - grad hor p(r, Y t )dt + £ Vi(Y t ) o dB\ 

i=i 

out of two reasons: first the law of X^r is an invariant measure for Y and, second, 
there is a spectral gap for Y if X satisfies a Driver-Melcher inequality (see section 
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4 for precise details). We can easily extend all results to compact homogeneous 
spaces M. 

The possible exponential convergence rate is then applied for new simulated 
annealing algorithms. The interest in those new algorithms lies in the fact that 
there are less Brownian motions than space dimensions of the optimization prob- 
lem involved, and that the stochastic differential equations might have a smaller 
complexity and is therefore easier to evaluate. 

For this purpose we consider cases where the size of the spectral gap for the 
previously introduced process Y is ^7 for some constant K > (see section 5 for 
precise details). This holds true for instance on SU(2) or on the Heisenberg tori. 
Let U be a smooth potential on M. We regard an equation of the type 

1 d 

dZ t = -- grad fcor U(Z t )dt + e £ V q {Z t ) o dB\ 

»=i 

as a compact perturbation of the natural OU process in order to get an estimate 
for its spectral gap, which can be expressed by 

\U(x) + £ 2 logp(e 2 ,x ,x)\ < D 

for all x <E M and some constant D. This amounts to a comparison of U with the 
square of the Carnot-Caratheodory metric d(xo,x) due to short-time asymptotics 
of the heat kernel on the compact manifold M. 

A concatenation of trajectories of such equations under a cooling schedule t 1— > 
em = c leads then to the desired simulated annealing algorithms. The 

_ Vl0g(R+t) 

analytical arguments are strongly inspired by the seminal works of R. Hollcy, 
S. Kusuoka and D. Stroock [HS88] and |HKS89j . 

2. Preparations from functional analysis 

We consider a finite-dimensional, connected Lie group G with Lie algebra g, its 
right-invariant Haar measure \i and a family of left-invariant vector fields V\ , . . . , Vd € 
0. We assume that Hormander's condition holds, i.e. the sub-algebra generated by 
Vi,...,Vd coincides with q. 

We consider furthermore a stochastic basis (f2, J 7 , P) with a d-dimensional Brow- 
nian motion B and the Lie group valued process 

d 

dX? = ^Vi(X?)odBi, X£=xeG. (2.1) 

i=l 

The generator of this process is denoted by C, we have 

1 d 

i=l 

where we interpret the vector fields as first order differential operators on C°° (G, R) . 
Furthermore, we define a semigroup P t acting on bounded measurable functions 
/ : G -> R by 

P t f(x) = E(/(Xf )) . 

This semigroup can be extended to a strongly continuous semigroup on L 2 (G, /z), 
which we will denote by the same letter P t . The carre du champ operator T is 
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defined for functions /, where it makes sense, by 

r(f,g) = C(fg)-.fCg-gCf . (2.2) 
In our particular case, we obtain immediately 

d 
i=l 

Notice that the carre du champ operator does not change if we add a drift to the 
generator C. 

Due to the right invariance of the Haar measure fi and the left-invariance of 
the vector fields Vj, the operator C is symmetric (reversible) with respect to /x and 
therefore /i is an infinitesimal invariant measure in the sense that J Cf(x) (i(dx) = 
for all smooth compactly supported test functions /. Furthermore, due to the 
symmetry of C we have from (|2.2[) the relation 

2 J fCgn=- Jv(f,g)n (2.3) 

for all / e Cff(G) and g e C°°(G). 

Let now U : G — ► M be an arbitrary smooth function such that 



Z := I exp(— U(x))n(dx) < oo . 
Jg 

We consider the modified generator 

CP :=C-±r(Ur), 

Notice that pF = exp(— U)fj, is an infinitesimal invariant (finite) measure for C u , 
since, by 



£ u f[i u = I (£f)exp(-U)fi-l I T(U,f)exp(-U)fi 



l - J T{f,eM-U))»-\ J T(f,U)eM-U)n = 0, 
ymmetric on L 2 {yF) in the sense that 

J f£ u w u = J g£ u fv u = -\J r(f,g)n l 



2 

and notice that C u is symmetric on L 2 (/i u ) in the sense that 

,u 



for all smooth compactly supported test functions /, g : G — * M. The last equality 
is often referred to as integration by parts. 

By definition and by integration by parts the operator C u has a spectral gap at 
of size a > in L 2 (p u ) if and only if 

T{}J)(x)^(dx) >2a [ f(x) 2 fi u (dx) , 
Jg 

for all compactly supported smooth functions f on G satisfying 

f(x)fi u (dx) = . 



If we want to write an inequality for all test functions /, it reads like 
f r(f,f)(x) f i u (dx)>2a([ f(xffx u (dx) f fjF(dx)-([ f(x)fi u (dx)) 2 ) (2.4) 

J G J G J G J G 
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for all test functions / € Cq°(G). 

3. Strong existence of OU-processes with values in Lie groups 

Let G be a finite-dimensional, connected Lie group. We consider now the special 
case of the 'potential' W t {x) = —logp(t,x), t > 0, where p(t,x) is the density of 
the law of with respect to p.. By Hormander's Theorem [Hor67l lHor07] . the 
function (t, x) i— > p(t, x) is a positive and smooth function, hence the potential Wt 
is as in the previous section. We write for short £* instead of C Wt and we call 
the associated Markov process the natural OU-process on G associated to 
the diffusion X. We show that we have in fact global strong solutions for the 
corresponding Stratonovich SDE with values in G. The next proposition is slightly 
more general. 

Proposition 3.1. Consider a smooth potential U : G — > R such that 

J cxp(— U(x)) p,(dx) < oo . 
Consider the following Stratonovich SDE with values in G: 

d 

dY t v = V Q (Y t y )dt + J2Vi(Y t v )odBl , YV = yeG, (3.1) 
i=i 

where VqJ = —hT(U,f) for smooth test functions f. Then there is a global strong 
solution to \3.1\) for all initial values y € G. 

Proof. Since the coefficients defining (|3.ip arc smooth by assumption, there exists 
a unique strong solution up to the explosion time 

C y = mf{t : limY? = oo} . 

We then define a semigroup Vt on L 2 (fjF) by 

(^/)(y)=E(/(y*)l fy>t ) . (3.2) 

It can be shown in the exact same way as in |Che731 ILi92) that Vt is a strongly 
continuous contraction semigroup and that its generator A coincides with C u on 
the set C^°(G) of compactly supported smooth functions. 

On the other hand, setting V(C U ) = Cg°(G), one can show as in |Che73l ILT92] 
that C u is essentially self-adjoint, so that one must have A = C u = (C u )*. In 
particular, since the constant function 1 belongs to L 2 (G,[i u ) by the integrability 
of exp(— U) and since / (£ u ijj)(x) n u (dx) = for any test function tp € Cq°(G), 1 
belongs to the domain of (£ u )* and therefore also to the domain of A. This then 
implies that Vtl = 1 by the same argument as in (Li92j. In particular, coming 
back to the definition (|3.2p of Vt, we see that P(C^ = °°) = 1 f° r every y, which is 
precisely the non-explosion result that we were looking for. □ 

Remark 3.2. While this argument shows that, given a fixed initial condition y, 
there exists a unique global strong solution to \3.1)) , it does not prevent more 
subtle kinds of explosions, see for example |Elw78j . 

By Proposition 13.11 and since p(t,x) is smooth and integrable, it follows imme- 
diately that the OU-process exists globally in a strong sense. 
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Corollary 3.3. For any given t > 0, the process 

d 

dY? = V p?)dt + £ Vi(Y?) o dB\, YV = ye G, 

i=l 

with Vof = — ir(W r , /) ftas a global strong solution. 

Remark 3.4. More traditional Lyapunov-function based techniques seem to be 
highly non-trivial to apply for this situation, due to the lack of information on 
the behaviour ofU(y) at large y. In view of BA88 ( Lca87b, Lca87a , it is tempting 
to conjecture that one has the asymptotic 

lim T 2 d T \ogp(T,y)=d 2 (e,y) , (3.3) 

and that the limit holds uniformly over compact sets K that do not contain the 
origin e. (Note that it follows from [BA88j that this is true provided that K does 
not intersect the cut-locus.) If it were the case that 13. 3\) holds, possible space-time 
scaling properties of p(r, x) could imply that, for every r > 0, there exists a compact 
set K such that Cp{r, x) = d T p(r, x) > for x £ K . On the other hand, one has 

C T W T = ~T(W T , W T ) + CW T - ^ 



so that this would imply that W T is a Lyapunov function for the corresponding 
Ob 1 -process leading to another proof of the previous corollary. 

4. Spectral Gaps for natural OU-processes 

Next we consider the question if £* admits a spectral gap on L 2 (pt fi) for t > 0, 
which turns out to be a consequence of the Driver-Melcher inequality (see [Mel04j ) . 

Theorem 4.1. The following assertions are equivalent: 

• The operator £* has a spectral gap of size a t > on L 2 {jp t fi) for all t > 0, 
and a positive function a : R>o — > R>o- 

• The local estimate 

Pt(r(fJ))(g) > 2a t ((P t f 2 )(g) ((P t f)(g)) 2 ) 

holds true for all test functions f : G — > M, for all t > and a positive 
function a : K>o — > K>o a>t one (and therefore all) point g G G. 
Furthermore, if we know that 

T(P t f,P t f)(e)< V (t)P t {T(f,f)){e) 

holds true for all test functions f £ Cq°(G), all t > 0, and a strictly positive locally 
integrable function (p : R>o — > R>o> then we can choose a t by 

r 

a t 



J (p(t- s)ds = i , 



for t > and the two equivalent assertions hold true. 

Proof. Since fi Wt is equal to the law of Xf, one has J f '/j, Wt = Ptf{e) for every 
/ G C(f(G). The equivalence of the first two statements then follows from (|2.4p 
and the fact that the translation invariance of (|2.ip implies that if the bound holds 
at some g, it must hold for all g G G. We fix a test function / : G — > E as well as 
t > and consider 

H(s) = P s ((P t - s f) 2 ) 
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for < s < t. The derivative of this function equals 

H\s)=P a (T(Pt-.f,Pt- a f)) 
and therefore - assuming the third statement - we obtain 

H'( S )<^t- S )P t (T(fJ)). 

Whence we can conclude 

H(t)-H(0)< f <p(t- s )dsP t (T(fJ)), 
Jo 

which is the second of the two equivalent assertions for an appropriately chosen 
a. □ 

Remark 4.2. We can replace the Lie group G by a general manifold M, on which 
we are given a hypo-elliptic, reversible diffusion X with "sum of the squares" genera- 
tor C. Then the analogous statement holds, in particular local Poincare inequalities 
on M for C lead to a spectral gap for the OU-type process £* with t > 0. 

Corollary 4.3. Let G be a free, nilpotent Lie group with d generators e±, . . . , ed of 

step m > 1, and consider 

1 d 

i=l 

then the operator £} has a spectral gap of size at = jf^ on L 2 (p t fi) for some 
constant K > 0. 

Proof. Due to the results of the very interesting Ph.D. -thesis |Mel04j (see also 
[DM07]), there is a constant K such that the bound 

T(P t f,P t f)(e)< KP t (T(f,f))(e) 

holds true for all test functions / G C^°(G) and for all times t > 0. This shows that 
atKt = \, due to the assertions of Theorem 14. 11 □ 

Corollary 4.4. Let G = SU(2) be the Lie group of unitary matrices on C 2 with Lie 
algebra g = su(2) = fc) ffi with the usual commutation relations, i.e. = 2k 
and its cyclic variants. Consider 

where we understand the elements i,j as left-invariant vector fields on G, then £' 
has a spectral gap of size at = jj^ on L 2 (p t /x) for some constant K > 0. 

Proof. The result follows from |BB08j [Prop. 4.20]. □ 

4.1. Generalisation to homogeneous spaces. Consider now M a compact ho- 
mogeneous space with respect to the Lie group G, i.e. we have a (right) transitive 
action % : G x M — > M of G on M. We assume that there exists a measure fi AI on 
M which is invariant with respect to this action. We also assume that we are given 
a family V\ , . . . , Vd of left-invariant vector fields on G that generate its entire Lie 
algebra q as before. These vector fields induce fundamental vector fields V^ M on M 
by means of the action tt. 

By choosing an 'origin' o G M, we obtain a surjection 7r: G — > M by n(g) = 
n(g, o). The vector fields V\,...,Vd and , . . . , V d M are consequently 7r-related. 
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Due to the invariance of [x M with respect to the action tt, the vector fields V^ M are 
anti-symmetric operators on L 2 (/j, M ) and the generator 

i=i 

is consequently symmetric on L 2 (/j, M ). In particular we have 

(V^f)on = V l (fo 7 r) 

for i = 1, . . . , d. The local Driver-Melcher inequality on G translates to the same 
inequality on M by means of 

P t M (/)o7r = P t (/o7r) 

for test functions / : M — > R, hence we obtain the corresponding Driver-Melcher 
inequality on M with the same constants, too. 

5. A SIMPLE RESULT ON SIMULATED ANNEALING 

By comparison with natural OU-processes on the homogeneous space M we 
can obtain spectral gap results for quite general classes of potentials. For later 
purposes, namely for applications to simulated annealing algorithms, we shall state 
a parametrized version of a simple perturbation result. 

Theorem 5.1. Let M be a homogeneous space. Let V E : M — ► M be a family of 
potentials V E with 

\V £ +logp(e,-)\<D E 

for < e < 1, and constants D e > 0. Assume furthermore that a Poincare 
inequality holds for C s , i.e. 

a e P E (f)(e)<P e (T(f,f))(e) (5.1) 

for test functions f G Cq°(M) with P e f(e) — and some constant a £ > and 
< e < 1. Then one has exp(— V e ) £ L 1 ^) and the Poincare inequality 

/ 2 (x)exp(-V/ £ (£)Hdx-) < C e J r(f,f)(x)exp(-V e (x))fx(dx) (5.2) 

holds for all test functions f G Cq?(M) with J f{x) exp(— V e {x))^{dx) = and some 
constant C e = C:>C P( 2D ^ > 0. Ln particular, this leads to a spectral gap of size at 
least 

1 a e 
C~ £ = exp(2D e ) 

for C v - . 

Proof. It follows immediately from the inequality 

p(e,x) = exp(— V E (x)) exp(V E (x))p(e, x) > exp(— D e ) exp(— V E (x)) 
that exp(— V E ) G L 1 ^). Furthermore, 

exp(-V e (x)) = — 1 y; P(£,x) > exp(-D E )p{e,x) 

p{s,x) cxp{V E (x)) 

for all x G M by assumption. Hence we deduce (|5.2p with C E = CX P( 2D ») from 
(EU). □ 

Remark 5.2. See [BLW07] for results on unbounded perturbations. 
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Throughout the remainder of this section we assume that M is a compact ho- 
mogeneous space with respect to a connected Lie group G. We consider the same 
structures as in Section 14.11 on M, but we omit the index M on vector fields and 
measures in order to improve readability. We shall furthermore impose the following 
assumption on the spectral gap: 

Assumption 5.3. There is a constant K > such that 

r(P t f,P t f)(e) < KP t (T(f,f))(e) 
holds true for all test functions f G C^°(M) and < t < 1. 

We prepare now a quantitative simulated annealing result under the previous 
Assumption 1531 on M and follow closely the lines of |HS88j . Let U : M — > K be a 
smooth potential. The idea is to search for minima of U by sampling the measure 

1 U 

Recall that we do always assume that Z E = J M exp(— ^)fj, < oo. Sampling this 
measure is performed by looking at the invariant measure of 

Notice that the previous operator satisfies 

e 2 C e = e 2 C - \v{U, .), 
and a spectral gap for e 2 £ £ is a spectral gap for the diffusion process 

d 

dY? = V (Y t V)dt + £ eViO?) o dBi = y e G, 

i=l 

with Vof = —^T(U, /). Consequently we know - given strong existence - that the 
law of Y^ converges to exp(— and concentrates therefore around the minima 
of U. In this consideration e is considered to be fixed. Next we try to obtain a time- 
dependent version of the previous considerations, leading to a process concentrating 
precisely at the minima of U. 

In the following theorem we quantify the speed of convergence towards the in- 
variant measure. We denote by \i e the probability measure invariant for C e and we 
use the notation 

var £ (/) = ((/-(/)j\ 
with (f) £ = f M f(g) He(dg) for the variance with respect to this measure. First we 
estimate the spectral gap along a cooling schedule 1 1— > s(t), then we prove that the 
measure concentrates around the minima of U even in a time-dependent setting. 

Theorem 5.4. Let U : M — ► M be a smooth functions, D a constant, xo £ M a 
point such that 

\U(x)+e 2 \ogp(e 2 ,x ,x)\ <D, 

for all x £ M. Then there exist constants R,c > such that for e(t) = ., c 

W \/log(fl+t) 

vax e(t) (f)<K(R + t)(^T(f,f)) e(t)) 
for all test functions f £ C^°(M) and t > 0. 
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Proof. We can start to collect results. Combining Assumption ^ . 31 with Thcorcm l5.ll 
applied for V E = jy, we obtain that spectral gap for the operator C e has size at 
least 

1 / 2D\ 

for < e < 1, so that e 2 C e has a spectral gap of size at least 

2D\ 



^cxp(- 



K \ e z I 

We choose c 2 = 2D and R sufficiently large so that s(t) < 1 for t > 0, and we 
conclude that 

Aexp(-^) < A'(i? + t) 

for alH > 0, which yields the desired result. □ 

We denote by Z the process with cooling schedule t t— *• e(t) as in the previous 
theorem, 

d 

dZ z t = V (Z*)dt + ^Wi( z t) ° dB l > 

i=l 

where the drift vector field is given through Vb/ = -\Y{U,f). Then the previous 
conclusion leads to the following proposition. 

Proposition 5.5. Let f t denote the Radon- Nikodym derivative of the law of Z£ 

with respect to pb e M and let 

nit) :=||/,-l|lW. (t) ) 
denote its distance in L (jj, s m) to 1 (which corresponds to var e ( 4 ) (ft)), then 

for the constants R,c and K from Theorem\5.4\ and N = max U — min U . 



Remark 5.6. We find c 2 > 3NK, such that sup t >ou(t) is bounded from above by 
a constant depending on /o, c, R. N and K . 



Proof. The proof follows closely the lines of [HS88j . By assumption wc know that 
var e(t)(/t) = u(t) = ll/t|lz,2 (/Mt3 ) - 1 and hence with the notation f3(t) = 

u'(t) = -(T(f t J t )) e{t} -f3'(t) f (U-(U) £(t) )f^ t 



= -FVtJt)U t ) - P'(t) J{u~ (u) m )(f t - - 

-2f3'(t) J{U-(U) e(t) ){f t -l)^ t 

- K(R + t) W c 2 (R + t) w c 2 {R + t) V W 

Here, we used the Cauchy-Schwarz inequality and the conclusions of the previous 
Theorem 15.41 in the last line. □ 
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Assumption 5.7. Let U : M — ► R be a potential on M such that 

\U(x)-d(x,x ) 2 \<D 1 

for some positive constant _D 1; a point x £ M and for all x G M . Here we denote 
by d(x, xq) the Carnot-Caratheodory metric on M , see for instance |Lea87b[|Lea87aj 
and [SUM]. 

Remark 5.8. For non- compact manifolds M the limit 

lim t \ogp(t, xq, x) = —d(xo,x) 2 

is uniform on compact subsets of M , but usually not on the whole of M . An 
abelian, non-compact example where the limit is globally uniform is M = M. d . On 
the simplest non-compact and non-abelian example, the Heisenberg group G\, the 
limit is not uniform, see recent work of H.-Q. Li [Li] . Therefore we consider in our 
perturbation argument only compact manifolds M . 

On compact manifolds M we know due to R. Leandre's beautiful results |Lea87b[ 
ILea87aj that there is D2 such that 

\d(x ,x) 2 + e 2 logp(e 2 ,x ,x)\ < D 2 

for x S M. Hence we can conclude by the triangle inequality that the potential U 
satisfies the assumptions of Theorem 15.41 

Theorem 5.9. Assume Assumptions [573\ and \57^ and assume that 

SUpt>v\\ft\\L*^ E{t) ) < 00 . 

Define Uq = inf 2 . 6 j\/ U(x) and, for every S > 0, denote by As the set As = {x £ 
M I U(x) > Uq + 5}. Then we can conclude that 

P(Z t z e As) <M^ e[t) {As) 
for every t > and every 5 > 0. 

Proof. It follows from the Cauchy-Schwarz inequality that 

V{Zt e At) = f ftHs(t) < MJ(i e(t) (As), 

J A s 

as required. □ 

Remark 5.10. Since lim e _,o Hs{As) = for every S > 0, we obtain that for all 
continuous bounded test functions f , we have 

E(/(Z t «)) -> f(x ) , 

provided that there is only one element xq £ M such that U(xq) = Uq. 

Remark 5.11. We can improve the previous result from L? -estimates to Li- 
estimates for II/* — l|lia(^ t )j f or Q > 2: this follows [HKS89, Theorem 2.2] and 
the fact that the proof of |HKS89( Theorem 2.7] appl ies due to a valid Sobolev 
inequality, i.e. for every q > 2 there is a constant Cq > such that 

H/llL M <o4 / + 11/11 W)) 

z J M 

holds for all test functions f : M — > R. Such a Sobolev inequality can be found for 
instance in |Hor67[ Section 3] or in |SC84j . 
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Remark 5.12. We can apply hypo- elliptic simulated annealing to potentials on 
compact nilmanifolds with the respective subriemannian structure due to Corollary 
\4-S\ or we can apply it to potentials on SU{2) due to Corollary \4-4\ 

The implementation of those new algorithms can yield some advantages with 
respect to elliptic simulated annealing algorithms on Riemannian manifolds as de- 
scribed in |HKS89j . On the one hand the number of Brownian motions involved is 
smaller, such as the complexity of the SDE 

d 

dZ z t = V {Z~)dt + e{t)Vi{Z z t ) o dB\ . 

i=l 

as a whole, since less vector fields have to evaluated and the gradient Vq is less com- 
plex being a horizontal gradient. The price to pay is a larger constant c > in the 
rate of convergence. In cases where hypo-elliptic simulated annealing can be directly 
compared with elliptic simulated annealing on flat space (for instance on 3-torus T 3 , 
where we have the flat euclidean structure and the subriemmanian structure of the 
Heisenberg torus with two generators ) the elliptic algorithm is superior. This is due 
to the fact the one can choose the vector fields in the elliptic algorithm constant ( on 
flat T 3 ) which reduces the complexity considerably, whereas one has to apply more 
sophisticated vector fields in the case of the Heisenberg group. 

For optimization on SU(2), where our theory applies due to Corollary \4-4\ we 
have a visible advantage over the elliptic simulated annealing, since we need one 
more Brownian motion and one more vector field for the elliptic algorithm, and we 
cannot simplify the vector fields in the elliptic algorithm. 
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